Padding and truncation
https://huggingface.co/docs/transformers/en/pad_truncation
#huggingface/tokenizers
The three arguments you need to are: padding, truncation and max_length.
truncation
padding
max_length
表は必読感がある